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ABSTRACT 


In biotechnology, using image processing techniques 
to extract suitable information from C.Elegans nematode 
worms has recently drawn an increasing research interest. 
Many important problems in this area have not been solved 
yet, especially detection of each individual in population im- 
ages. In this paper, we propose a method to detect individuals 
in population images. Our method is based on three steps: 
Pre-processing where a smooth skeleton is obtained from the 
image, Splitting skeleton into branches and angle calculation 
of each branch and finally merging the branches in order to 
detect each individual in the image. The outcome of the pro- 
posed method is a vision algorithm with 7.9% False Rejec- 
tion Rate (FRR) and 8.4% False Acceptance Rate (FAR) on 
a database of 255 isolated and overlapped worms. 


1. INTRODUCTION 


In biotechnology, visualization of large number of micro- 
organisms is a necessary step for studying the effect of chem- 
ical compounds on complex eco-systems, finding growth rate 
and movement patterns, describing the culture composition 
and recently using fluorescent markers measuring the distri- 
bution of proteins and organ development. Nematoda phy- 
lum is one of the most important families of micro-organisms 
which abundantly exists in terrestrial and marine environ- 
ment and also as a guest inside large number of plants and an- 
imals. A famous member of this family named Caenorhabdi- 
tis Elegans (C.Elegans) used as a model organism [1] has at- 
tracted increasing research and commercial interests in ecol- 
ogy, molecular and developmental biology. C.Elegans is an 
unsegmented bilateral symmetric worm with wide thickness 
in the center and narrow near the head and tail. Because of its 
simple and featureless shape, detection and characterization 
is a challenging task for computer vision algorithms espe- 
cially in presence of large number of specimens with strong 
overlapping between each other and with the plate. 
Although image processing tools are utilized widely in 
daily lab work, the major part of the process is still labor in- 
tensive. Commercial software often employs semi-automatic 
approaches in order to effectively reduce the amount of time 
spent on analyzing single images with a few number of spec- 
imens. For video-sequences and massive population images 
these semi-automatic approaches are not suitable and fur- 
ther automation is necessary in order to process the higher 
amount of image data efficiency. As mentioned in [1], the 
need of high-throughput visualization of worms to fully de- 
scribe biological processes on a quantitative level is still very 
much in demand. Recently, several integrated machine vi- 











sion systems have been developed. The goal of such sys- 
tems is tracking a significant number of individual organisms 
and measuring parameters such as size, mobility, shape fea- 
tures, or fluorescent marker distribution as a function of time. 
[2] introduces a single worm detection algorithm which uses 
contour curvature patterns of the image skeleton to find the 
worm’s head and tail. Morphological aspects of internal or- 
gans and an interaction detection procedure are used for ne- 
matode classification in [3]. The first work on C.Elegans be- 
havioral phenotypes classification was done in [4] for motion 
pattern identification by means of a single nematode tracking 
system, morphological operators with grey scale threshold- 
ing and geometrical related features. Nematode population 
analysis based on basic image processing algorithms was in- 
troduced in [5] in a semi-automatic manner. Movement of 
a single worm is recorded in [6] by means of a motor-based 
tracking system, which makes the worm in the center of the 
video frame. The head and tail of the worm are extracted 
and 94 geometrical features are calculated for every frame. 
A Random Forests classifier identifies up to 15 different mu- 
tant types using these features. The accuracy of the method 
on a database of around 1600 individual nematode video se- 
quences is about 90% . In [7], detection of worms in pop- 
ulation images has been addressed using energies of opti- 
mized active contours to discover common worm patterns 
in the image. The extracted patterns are entered to a prob- 
abilistic classifier in order to distinguish among nematode 
and non-nematode objects. Although these methods work 
powerful in order to distinguish between nematode and non- 
nematode objects, their False Rejection Rate (FRR) is sig- 
nificantly high. Moreover, optimization of the contours 1s a 
time consuming task, due to which these methods work very 
slow. 

In this paper, we propose a skeleton-based analysis to de- 
tect and distinguish the individuals in population images with 
83.7% True Acceptance Rate (TAR) and fast enough to be 
used in real-time applications. We also explain a possible 
application of this method in contour-based worm tracking 
algorithms in video sequences. 











2. THE VISION IDEA 


The proposed method is described in figure 2 in pseudo-code. 
The method consists of the following three parts: 


2.1 Pre-processing 





There are several methods in literature to obtain an image 
skeleton. We used a Gaussian smoothing filter with size 
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Connection- Pixel 


| |: Branch Pixel 


i È : Junction-Pixels 
im : End-Pixels 
GH. Connection-Pixels 


Figure 1: The angle calculation procedure of a Connection- 
Pixel. The red boxes, the dashed line boxes and the 
green boxes are Connection-Pixels, Junction-Pixels and End- 
Pixels, respectively. The 6;; is the angle between the i” and 


J” pixels in the same Connection-Branch. 


20 x 20 and o = 1.0 in order to blur the image. Subtraction 
of the original image from the blurred image results in de- 
tection of high frequency pixels (the edges). We use a global 
threshold calculated by the Otsu method to binarize the re- 
sult. By applying a morphological closing we remove the 
small spots inside the objects. Then we produce the image 
skeleton using a morphological skeleton algorithm. Because 
of some spots inside the binary image, the skeleton has some 
extra branches which should be pruned in order to improve 
the algorithm efficiency. We use the following definition in 
the rest of the paper: 
e Junction-Pixel: Pixels inside the skeleton with more than 
two neighbors. 
e End-Pixel: Pixels inside the skeleton with only one 
neighbor. 
e Connection-Pixel: Pixels inside the skeleton with only 
one neighbor after removing the Junction-Pixels. 
e End-Branch: A branch with one End-Pixel and one 
Connection-Pixel in both sides. 
e Connection-Branch: A branch with two Connection- 
Pixel in both sides. 














2.2 Splitting skeleton into independent branches: 


After obtaining a smooth skeleton, the skeleton is splitted 
into several branches by removing the Junction-Pixels which 
produces a combination of Connection-Branches and End- 
Branches. For each Connection-Pixel, an angle is calculated 
by averaging angles between sequential pixels for a user- 
defined number of pixels in the branch (N) starting from 
that Connection-Pixel. For example in figure 1, the angle 
of Connection-Pixel is: 


012 + 034+ 634+...+ ON—1,N 
N-1 


The parameter N is important and should be assigned 
an appropriate value. For angle calculation, this parameter 





(1) 


Oc onnection— Pixel — 


Pre-processing: 
1. Image binarization 
- Image blurring by a 20*20 gaussian smoothing filter. 
- Subtraction of the original image and the blur image. 
- Calculation of global threshold by Otsu method. 
- Binarization of the subtraction image by the threshold. 
2. Small hole filling 
- Morphological closing. 
- Remove small regions. 
3. Skeleton & pruning 
- Morphological skeleton. 
- Remove small branches in the skeleton. 


Splitting skeleton into independent branches: 

4. Find Connection-Pixels and Junction-Pixels in the image 
skeleton. 

5. Remove Junction-Pixels and split the skeleton into 
Connection-Branches and End-Branches. 

6. Calculate each Connection-Pixel angle by averaging angles 
between sequential pixels for N pixels in the related branch 
starting from that Connection-Pixel using equation 1. 


Merging branches for individual skeleton reconstruction: 
7. Start from the first End-Branch. 
8. Assign a new tree to the current End-Branch. 
9. Add neighbor branches to the tree last branch if they 


satisfy |9;-eelastbranch _ (180 P O eionborebranch, | = Orn 
10. Reconstruct each worm using obtained paths. 
11. Go to step (8) for the next End-Branch. 


Figure 2: An abstract explanation of our proposed method for 
detection and separation of individual worms in a population 
image. 


not only must be big enough to avoid the influence of ir- 
regular sharp changes near the Connection-Pixels but it also 
should be small enough not to include the pixels far from the 
connection-pixel. 


2.3 Merging branches for individual skeleton recon- 
struction: 


For each End-Branch, an individual tree is assigned. The 
trees are grown up by attaching appropriate neighbor 
Connection-Branches. The following rules are used to con- 
struct a tree path: 


1. The last branch of a path (r’” branch) is attached to k” 
branch if firstly they have neighbor Connection-Pixels 
and secondly these Connection-Pixels angles satisfy: 





|O; — (180 + Ok)| < Orn (2) 


where Orp is defined by user. 

2. The path growing stops when its last branch is an End- 
Branch or the neighbor branch can not satisfy the condi- 
tion in (2). 

To better understand, the procedure is explained by an 
example. There are three overlapped worms in figure.3. Re- 
fer to the definition, all branches except branch 4 are End- 
Branches. The algorithm starts from branch | by assigning 
an individual tree. The neighbors of this branch Connection- 
Pixel with 0; = 48° are Connection-Pixels of branches 2, 
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3 and 4 with @ = 126°, 03 = —57° and @& = —111°, re- 
spectively. For Ora = 50°, only 04 can satisfy the condition 
in (2). So branch 4 and 64’ become the tree last branch 
and the tree last Connection-Pixel, respectively. The tree 
last Connection-Pixel (04^) has two neighbors: Connection- 
Pixels of branches 5 and 6 with 05 = 156° and 06 = —39° , 
respectively. Because none of these angles satisfy the con- 
dition in (2), the tree path stops here. To conclude, the tree 
starting from the first End-Branch has only one path with two 
members: | and 4. The same procedure is executed for the 
other End-Branches. 





















0, =126° 





À A 9 = 48" 
EVN 
E K j oÑ -57 
A ee 
9, =156 \ 
0, = 


Figure 3: A detail example to clarify the procedure: (a) orig- 
inal image (b) its smooth skeleton after removing Junction- 
Pixels. The Connection-Pixels angles are calculated with 
N = 15 pixels and Or, = 50°. Based on the method outcome, 
each of the paths 1-4, 2-3 and 5-6 are individual worms. 


3. EXPERIMENTAL RESULTS 


The database used in this paper consists of 5 population im- 
ages including 255 isolated and overlapped worms. We use 
three indications to judge the method: 


e True Acceptance Rate (TAR): the number of correctly de- 
tected worms. 

e False Acceptance Rate (FAR): the number of non-worm 
objects detected as worms. 

e False Rejection Rate (FRR): the number of undetected 
true worms. 


Table.1 indicates these rates for the utilized database. The 
method outcome has also been shown in figures 4 and 5. In 
both figures, the first row includes original image and the 
second row is the method result where green, yellow and red 
colors refer to the correct detected, incorrect detected and 
correct undetected worms, respectively. In our experience, 
the best result is obtained with Or, = 50° and N = 15 pixels. 





Table 1: The proposed method result for a database of 255 
individuals with Or, = 50° and N = 15 pixels. 


EI Percentage (Number) 

True Acceptance Rate (TAR) | 83.7% (232) 
| 
| 


7.9% (22) 


8.4% (23) 


False Acceptance Rate (FAR) 
False Rejection Rate (FRR) 





4. CONCLUSION AND FUTURE WORK 


In this paper, a skeleton based analysis is proposed for detec- 
tion and separation of C.Elegans nematode worms in popu- 
lation images. The method first splits the skeleton obtained 
from a pre-processing step into several Connection- and End- 
Branches. Then it calculates an angle for each Connection- 
Pixel. Finally, an individual tree is assigned to each End- 
Branch. The tree is grown up based on angle analysis of its 
last branch and its neighbor branches. The algorithm chooses 
the appropriate neighbor branches with angle difference less 
than a user-defined threshold. Each path of the tree refers 
to a worm. Applying our method on a database of 255 ne- 
matode worms resulted in 83.7% accuracy for automatic de- 
tection. In addition to count the number of the worms by 
this method, its outcome can also be used as a first step of 
tracking of large number of nematodes in population video 
frames. In figure.6, the skeletons of two overlapped worms 
are detected and separated by our proposed method. A few 
pixels on each worm skeleton are chosen in order to divide 
the skeleton into several equal size segments. The perpen- 
dicular lines on skeleton in the chosen pixels are drawn. The 
intersection of these lines and the worm edge represent the 
worm contour points. These points can be used as an input 
material of contour-based tracking algorithm to track large 
number of specimens in population video sequences. 
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(b) 


Figure 4: The first example: (a) original image (b) the final 
result. The green color represents correct detected worms re- 
lated to TAR, the red color refers to incorrect detected worms 
related to FAR and the yellow color describes the correct un- 
detected worms. The parameters N and Orp are 15 pixels and 
50°, respectively. 
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(b) 


Figure 5: The second example: (a) original image (b) the fi- 
nal result. The green color represents correct detected worms 
related to TAR, the red color refers to incorrect detected 
worms related to FAR and the yellow color describes the 
correct undetected worms. The parameters N and Orp are 
15 pixels and 50°, respectively. 
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Figure 6: The procedure to use the outcome of the pro- 
posed method in this paper for tracking a large number of 
worms in population video sequences: (a) The original im- 
age. (b) Choosing some pixels on each worm detected skele- 
ton, drawing perpendicular lines and finding intersection of 
these lines and the worm edge. (c) The intersection points de- 
scribing the worm contour can be used as input of a contour- 
based tracking algorithm. 





